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I.  INTRODUCTION  AND  SUMMARY 


This  annual  report  summarizes  work  performed  on  the  Adaptive 
Decentralized  Control  project  (under  contract  F4920-81-C-0Q51)  during  the 
period  June  1982  -  July  1983.  The  objective  of  this  research  effort  Is  the 
development  of  a  new  concept  for  the  design  of  decentralized  controllers  for 
large  scale  systems. 

The  modeling,  analysis  and  control  of  large-scale  systems  is  an 
Increasingly  Important  problem  in  such  diverse  areas  as  defense  systems, 
communication  and  computer  networks  and  transportation  systems.  The  size  and 
complexity  of  many  systems  make  it  difficult  or  Impractical  to  use  centralized 
control  structures.  Furthermore,  considerations  of  communication  costs, 
system  reliability,  computational  requirements  and  response  time  provide 
strong  incentives  for  the  use  of  distributed  control  architectures.  The  basic 
focus  of  our  research  is  on  a  framework  within  which  decentralized  controller 
structures  can  be  analyzed  and  developed.  The  motivation  for  our  proposed 
approach  which  we  named  ADCON  (for  Adaptive  Decentralized  CONtrol)  comes  from 
the  following  observations  about  the  current  status  of  control  theory. 

An  important  aspect  of  centralized  control  has  been  the  study  of  systems 
with  unknown  or  uncertain  (time  varying,  random)  parameters.  The 
investigation  of  this  problem  led  to  an  extensive  literature  on  adaptive 
control  (also  called:  learning  or  self-organizing  systems).  The  natural 
progression  in  developing  centralized  controllers  was  from  the  non-adaptive 
case  to  the  more  difficult  problems  addressed  by  adaptive  techniques. 

The  study  of  decentralized  control  seems  so  far  to  be  almost  exclusively 
devoted  to  non-adaptive  techniques.  A  possible  explanation  of  this  state  of 
affairs  is  the  fact  that  the  area  of  decentralized  control  of  completely  known 
systems  still  has  many  unresolved  issues  and  some  basic  problems  are  yet  to  be 
answered.  Under  these  conditions,  there  seemed  to  be  little  incentive  to 
tackle  the  more  complex  adaptive  case  which  deals  with  partially  known 
systems.  However,  this  line  of  thinking  is  based  on  the  experience  gained  in 
centralized  control  and  it  may  be  inapplicable  in  the  context  of  the 
decentral ized  problem,  which  has  radically  different  characteristics.  In 
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fact,  adaptive  techniques  have  a  central  role  in  decentralized  control,  which 
is  of  a  somewhat  different  nature  than  the  role  they  play  in  the  centralized 
problem. 

To  understand  the  Interrelation  between  adaptive  and  decentralized 
control,  we  have  to  re-examine  the  basic  issues  underlying  the  need  for 
decentralized  control  strategies.  The  main  motivation  for  considering  such 
strategies  arises  in  the  context  of  complex,  large-scale  systems  where  a 
centralized  controller  usually  requires  excessive  computational  requirements 
and  excessive  Information  gathering  networks  to  make  such  a  controller 
feasible.  In  such  a  system.  It  is  re^onable  to  assume  that  the  local 
controller  (i.e.,  the  controller  of  one  subsystem  in  the  large  system)  has 
only  partial  information  about  the  rest  of  the  system.  Even  if  the  structure 
of  the  whole  system  (i.e.,  the  state  equations  of  all  subsystems  and  their 
interactions)  can  be  made  available  to  each  local  controller,  the  sheer 
complexity  of  the  problem  often  limits  the  usefulness  of  this  information.  In 
fact,  attempting  to  use  too  much  information  may  be  one  of  the  principal 
stumbling  blocks  of  conventional  approaches  to  decentralized  control.  Most  of 
these  approaches  try  to  solve  the  (optimal)  centralized  problem,  and  then  to 
find  clever  ways  of  decentralizing  the  solution.  The  shortcomings  of  this 
technique  and  the  need  for  a  different  point  of  view  are  by  now  widely 
recognized. 

The  basic  idea  underlying  our  approach  is  to  assume  that  from  the 
subsystem's  point  of  view,  the  rest  of  the  system  is  not  exactly  known.  Thus, 
the  subsystem  Is  aware  of  Its  own  structure,  but  It  has  only  an  approximate 
knowledge  of  the  rest  of  the  system,  for  example,  in  the  form  of  a  reduced 
order  model.  (Different  subsystems  will  use  different  models  of  the  "outside 
world".)  The  local  controller  Is  then  designed  on  the  basis  of  this  partial 
Information.  The  modeling  uncertainty  Inherent  in  this  procedure  makes  it 
necessary  to  consider  robust  or  adaptive  control  structures.  Note  that  the 
uncertainty  here  Is  due  to  the  complexity  of  the  system  rather  than  to  lack  of 
knowledge  or  to  random  effects,  which  are  the  traditional  sources  of 
uncertainty  In  centralized  control.  The  Idea  of  replacing  a  complex 
deterministic  problem  by  a  simple  stochastic  model  is  by  no  means  new,  and  has 
been  used  in  a  variety  of  physical  problems  (e.g.,  statistical 


thermodynamics) . 


The  use  of  reduced  order  models  and  partial  information  greatly 
simplifies  the  design  and  implementation  of  the  decentralized  controllers.  It 
raises,  however,  many  difficult  questions  regarding  the  conditions  under  which 
such  a  scheme  will  lead  to  satisfactory  system  behavior.  What  is  needed  is  a 
theory  for  the  control  of  interconnected  subsystems  in  the  presence  of  model 
uncertainties.  In  an  earlier  report  [36]  and  in  some  related  papers  we  made  a 
preliminary  study  of  some  of  these  issues. 

An  even  more  difficult  set  of  questions  arises  with  regard  to  the 
operation  of  adaptive  controllers  in  the  presence  of  uncertainty.  Currently 
available  adaptive  control  algorithms  have  been  shown  to  experience  severe 
difficulties  in  the  presence  of  unmodeled  plant  dynamics.  We  were  able  to 
derive  conditions  which  guarantee  that  the  adaptive  controller  will  have 
specified  performance  despite  plant  uncertainty  and  unmodeled  dynamics.  These 
conditions  provide  guidelines  for  the  analysis  and  design  of  robust  adaptive 
controllers.  A  combination  of  results  from  robust  control  and  adaptive 
control  theory  was  used  to  prove  the  main  theorem.  The  main  theorem  was 
applied  to  a  number  of  well-known  adaptive  structures:  the  direct  adaptive 
controller,  an  adaptive  observer,  the  indirect  adaptive  controller,  and  a 
general  form  of  the  model  reference  adaptive  controller  [40],  We  believe  that 
this  work  represents  a  significant  advance  in  the  field  of  adaptive  control. 

In  the  next  section  we  present  an  input-output  approach  for  analyzing  the 
global  stability  and  robustness  properties  of  adaptive  controllers  to 
unmodeled  dynamics.  The  concept  of  a  tuned  system  is  introduced,  i.e.,  the 
control  system  that  could  be  obtained  if  the  plant  were  known.  Comparing  the 
adaptive  system  with  the  tuned  system  results  in  the  development  of  a  generic 
adaptive  error  system.  Passivity  theory  is  used  to  derive  conditions  which 
guarantee  global  stability  of  the  error  system  associated  with  the  adaptive 
controller,  and  ensure  boundedness  of  the  adaptive  gains.  Specific  bounds  are 
presented  for  certain  significant  signals  in  the  control  systems.  Limitations 
of  these  global  results  are  discussed,  particularly  the  requirement  that  a 
certain  operator  be  strictly  positive  real  (SPR)  --  a  condition  that  is 
unlikely  to  hold  due  to  unmodeled  dynamics.  The  work  summarized  in  this 


II.  ROBUST  ADAPTIVE  CONTROL:  CONDITIONS  FOR  GLOBAL  STABILITY 


1.  INTRODUCTION 

1.1  Background 

The  analysis  and  design  of  adaptive  control  systems  has  been  the  subject 
of  extensive  research  In  the  past  two  decades  [1]-[10],  Adaptive  techniques 
provide  a  way  of  handling  plant  uncertainty  by  adjusting  the  controller 
parameters  on-line  to  optimize  system  performance.  An  alternative  method  for 
handling  uncertainty  Is  tc  use  a  fixed  structure  controller  designed  to 
provide  acceptable  performance  for  a  specified  range  of  plant  behavior.  In 
principle,  adaptive  controllers  can  provide  Improved  performance  compared  to 
fixed  robust  controllers,  since  they  are  tuned  to  the  uncertain  plant. 

However,  adaptive  controllers  sometimes  exhibit  undesirable  behavior  during 
the  tuning  or  adaptation  process.  For  example,  unmodeled  dynamics  can  cause  a 
rapid  deterioration  In  performance  and  even  instability  [11], [12].  This 
problem  Is  not  resolved  by  Increasing  the  order  or  complexity  of  the  model. 
Since  the  model  of  any  dynamic  system,  by  definition,  is  not  the  actual 
system,  it  can  therefore  be  argued  that  unmodeled  dynamics  are  always  present, 
ad  infinitum. 

The  main  reason  for  these  difficulties  with  adaptive  controllers  seems  to 
be  that  robustness  to  unmodeled  dynamics  was  not  considered  as  a  design 
criterion  In  the  development  of  the  adaptive  control  algorithm.  The  design 
objective  Is  global  stability  of  the  closed-loop  system,  e.g.,  [7],  [9]  and 
various  assumptions  on  the  structure  of  the  plant  are  required  to  achieve  that 
objective.  In  particular,  It  Is  necessary  to  assume  that  the  plant  Is  linear 
and  time  Invariant  (LTI),  that  the  relative  degree  of  the  transfer  function  Is 
known  as  well  as  the  sign  of  the  high  frequency  gain.  Such  requirements  are 
not  practical  since  real  plants  are  often  nonlinear  and  time-varying  and  can 
be  accurately  represented  only  by  high  order  (sometimes  Infinite  order  [13]) 
complicated  models. 

The  need  for  robustness  to  plant  uncertainty  is  not  unique  to  adaptive 
control.  The  problem  of  robustness  is  ubiquitous  in  control  theory  and  has 
been  studied  In  the  context  of  fixed  (nonadaptive)  control  [14]-[ 17] .  These 
studies  rely  on  the  Input/output  properties  of  systems,  e.g.,  [18], [19].  The 
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predominant  reason  to  examine  robustness  Issues  In  this  way  Is  that  the 
characterises  of  unmodeled  dynamics,  such  as  uncertain  model  order,  are 
easily  represented.  Lyapunov  theory,  on  the  other  hand.  Is  not  well  suited 
for  this  type  of  uncertainty.  Typically,  plant  uncertainty  Is  characterized 
by  assuming  that  the  plant  belongs  to  a  well  defined  set.  For  example,  a  set 
description  of  an  uncertain  LTI  plant  Is  to  define  a  "ball"  In  the  frequency 
domain.  The  center  of  the  ball  Is  the  nominal  plant  model,  and  the  radius 
defines  the  model  error.  This  set  model  description  Is  one  type  of  a  more 
general  set  description,  referred  to  as  a  conic-sector  [15],  The  uncertainty 
In  the  plant  Induces  an  uncertainty  in  the  input/output  map  of  the  closed-loop 
system  which  can,  again  be  characterized  by  a  conic  sector.  Performance 
requirements  for  the  control  system  can  be  translated  Into  statements  on  the 
conic  sector  which  bounds  the  closed-loop  systems,  making  it  possible  to  check 
whether  a  given  design  meets  specifications,  and  providing  guidelines  for 
robust  controller  design. 

In  this  study  we  use  the  input/output  approach  to  analyze  the  global 
stability  and  robustness  properties  of  continuous- time  adaptive  controllers 
with  respect  to  unmodeled  dynamics  (although  we  consider  only  conti nuous-time 
algorithms,  the  Input-output  formalism  can  be  readily  extended  to  the 
discrete-time  case).  By  global  we  mean  that  no  specific  magnitude  constraint 
(other  than  boundedness)  Is  placed  on  any  of  the  external  inputs  or  Initial 
conditons.  We  develop  an  adaptive  error  system  of  a  general  form,  by 
comparing  the  actual  adaptive  system  with  a  tuned  system,  i.e.,  the  control 
system  that  could  be  obtained  If  the  plant  were  known.  This  error  system  Is 
similar  to  the  type  used  In  [7], [8]  where  the  tuned  system  error  output  Is 
zero,  due  to  the  assumption  of  perfect  modeling.  By  relaxing  this  assumption 
we  show  that  the  non-zero  outputs  of  the  error  system  are  the  inputs  to  a 
nonlinear  feedback  error  system  consisting  of  the  adaptive  algorithm  and  two 
feedback  (interconnection)  operators.denoted  by  Hgv  and  Hzv  . 
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An  important  consequence  of  this  structure  Is  that  the  exi stence  of 
solutions  (e.g.,  tuned  system  performance)  Is  separated  from  the  stabiity 
analysis  (e.g.,  stability  of  the  nonlinear  error  system).  In  general,  the 
adaptation  law  is  passive;  consequently,  if  Hev  is  strictly  positive  real 
(SPR),  then  application  of  passivity  theory  [19]-[21],  provides  global 
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Lj-stablllty  of  the  map  from  the  tuned  system  output  to  the  actual  adaptive 
system  output,  even  though  the  adaptive  parameters  may  grow  beyond  all 
bounds.  We  provide  other  conditions  (e.g.,  Hzv  stable)  to  Insure  the 

l  boundedness  of  the  adaptive  gains.  Similar  results  are  developed  to 
00 

Insure  L  -stability  of  the  error  system  by  using  an  exponentially  weighted 

ao 

passivity  theory  [19].  These  results  are  summarized  in  Theorems  1A  and  IB. 

As  a  by  product  of  the  Input/ output  view  we  also  obtain  specific  bounds 
on  the  L«  and  L  norms  of  significant  signals  in  the  adaptive  system.  The 

C  * 

results  are  summarized  in  Corollary  1. 

The  results  in  Theorem  1  and  Corollary  1  are  not  essentially  new  (see 
e.g.,  [7], [8]),  although  they  do  provide  some  extentions  to  previous 
results.  The  main  contribution,  however,  is  the  fact  that  all  the  results  can 
be  obtained  from  a  generic  error  system  and  from  the  application  of  nonlinear 
stablity  theorems  based  on  input-output  properties.  As  a  consequence  of  this 
approach,  it  is  to  be  expected  that  conditions  for  robustness  will  arise  in  a 
natural  way.  Such  robustness  results  are  obtained,  but  unfortunately .they 
have  a  limited  practical  use.  The  main  limitation  is  that  the  global  theory 
(Theorem  1)  requires  that  Hgv  e  SPR  ,  which  in  turn  places  an  upper  bound  on 
the  size  of  the  unmodeled  dynamics  in  the  plant.  The  details  are  contained  in 
Lemmas  4.1  and  5.2.  This  bound  is  quite  restrictive  and  is  easily  violated  by 
even  the  most  benign  model  errors,  thus,  verifying  the  results  obtained  in 
[11],  [12].  To  over  come  this  limitation,  we  construct  an  SPR  compensator, 
based  on  the  scheme  proposed  In  [22]  in  the  context  of  robust  (non-adaptlve) 
control.  Although  in  the  adaptive  case  the  supporing  arguments  are  heuristic, 
an  example  simulation  shows  a  positive  result. 

The  Input/output  analysis  presented  here  provides  a  generic  framework 
within  which  it  is  possible  to  analyze  the  robustness  of  adaptive  robust 
controllers.  We  believe  that  this  framework  can  be  used  to  develop  practical 
adaptive  control  algorithms  that  can  be  more  readily  applied  to  real  systems, 
than  the  class  of  algorithms  currently  in  use. 

Since  this  study  merges  ideas  from  several  areas,  it  is  necessary  to 
introduce  a  number  of  definitions  and  concepts. 


2.  SOME  PRELIMINARIES 


2.1  Notation 


The  input/output  formulation  of  multivariable  systems  Is  the  principal 
view  taken  throughout  this  paper  and  the  notation  and  terminology  used  Is 
standard  (see  e.g.  [18] ,[19]).  The  Input  and  output  signals  are  assumed  to  be 
Imbedded  in  either  the  normed  function  space 

Lj  -  {x  :  [0,-)  *  Rn  |  | |x| |p  <  -}  (2.1a) 

or  its  extention 
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{x 


[0,T] 


T  <  ■»} 


(2.1b) 


The  respective  norms 


|.||p  and  ||.||Tp  are  defined  as  follows: 

I  M  lp  *  I  |x|  lTp 


(2.2a) 


with 


(/  |x(t)|pdt)1/p  ,  p  e  [1 ,«) 


sup  |x(t)| ,  P  = 

te[0,T] 


(2.2b) 


where  |.|  Is  the  Euclidean  norm  on  Rn.  Hence,  is  an  inner  product 
space,  with  inner  product  <x,y>y  of  elements  x,  y  e  l!je  defined  by 


<x,y>T 


T 

/  x(  t)  'y <  t) dt 
o 


(2.3) 


and  so  ||x||y2  3  (<x,x>y)^2  .  If  T  ♦  »  then  |_2  is  an  inner-product  space 
with  inner  product  <x,y>  =  lim<x,y>  . 


2.2  Stability 

Systems  considered  In  this  paper  are  described  by  Input/output  equations 

of  the  form  y  *  Gu  where  G:L™  +  Ln  Is  a  causal  map  from  u  Into  y,  also 

pe  pe 

denoted  u  +  y  •  The  system  G  Is  said  to  be  Lp-stable  (or  simply  stable)  If  G 

maps  u  e  lT  Into  y  e  tn  and  If  there  exists  finite  constants  k  and  b  such 
P  P 

that  | ) Gu | | jp  <  k  | | u | | Tp  ♦  b  ,  for  all  T  >  0  and  all  ueLpe  .  The  smallest 

k  that  can  be  found  Is  referred  to  as  the  Lp-ga1n  (or  simply  gain)  of  G, 

denoted  y  (G)  . 

P 

Because  we  often  encounter  LTI  systems  It  is  convenient  to  Introduce  the 

following  notation.  Let  R(s)  and  RQ(s)  denote  the  proper  and  strictly  proper 

rational  functions,  respectively.  Let  S  and  Sq  denote  functions  In  R(s)  and 

R  (s)  ,  respectively,  whose  poles  all  have  negative  real  parts.  Thus, 
o 

S  and  Sq  are  the  stable,  lumped,  LTI  systems.  Denote  multivariable  systems 
with  transfer  function  matrices,  by  R(s)nxm,  Snxm  ,  etc.  For  example, 

G  e  SgXm  means  that  all  elements  of  G  belong  to  Sq  ,  and  so  on. 

If  G  e  Snxm  then  the  following  lp-gains  are  obtained, 


Y,(G)  <  y  (G)  =  f  p[G(t)]dt 

1  •  0 

(2.4) 

y«(G)  =  sup  otG(jw)] 

^  D 

(2.5) 

where  F(A)  denotes  the  maximum  singular  value  of  the  matrix  A,  defined  as  the 
positive  square  root  of  the  maximum  eigenvalue  of  A*A,  where  *  is  the 
conjugate  transpose  of  A.  In  (2.4),  (2.5)  G  is  the  operator,  G(j<u)  the 
transfer  function  matrix,  and  G(t)  Is  the  Impulse  response  matrix. 

2.3  Passivity 

The  following  definitions  follow  those  In  [19], [21].  Let 
GiL^  +  L^e  and  let  y,  p  be  constants  with  y  >  0  .  Then,  Vue  L™e  : 


G  Is  passive  if, 


r* 

k 

/ 


V 

v’ 

'S  >s 
■i  o 


<  u,  G  u>^.  >  p 


G  Is  Input  strictly  passive  If, 


<  u,  Gu  >T  >  p  +  uJuaT2 


G  Is  output  strictly  passive  If, 


<  u,  Gu  >T  >  p  +  uiGuaT2 


(2.6) 


(2.7a) 


(2.7b) 


(u  and  p  are  not  the  same  throughout).  When  G  e  S™x™  satisfies  (2.7),  G  is 
said  to  be  strictly  positive  real  (SPR),  denoted  G  e  SPR™  .  Because  SPR 
systems  play  a  crucial  role  In  the  proof  of  stability  of  adaptive  systems,  we 
introduce  the  following  subsets: 


SPR^  ’  (G  e  SmXm|2^  [G(ju)  +  Gt-jo,)1]  -  y I )  >  0,  VueR} 


(2.8a) 


SPRq  *  {G  e  S™Xm|x(j  [ G(  ju» )  +  G(-ju) 1  ]  -  u  G( -ju.)  'G(  jo,))  >  0,  Vo,eR}  (2.8b) 

where  x_( A)  denotes  the  smallest  eigenvalue  of  A.  Thus,  whenever  g  e  Smxm  . 
conditions  (2.7)  can  be  tested  In  the  frequency  domain.  Moreover,  SPR™  and 
SPR™  .  respectively,  separate  the  strictly  proper  SPR  functions  from  the 
proper,  but  not  strictly  proper,  SPR  functions.  In  the  scalar  case,  the 
frequency  domain  conditions  simplify  because  ^CG(ju)  +  G(-ju)']* 

2  Re[G( ju>)]. 


Certain  unstable  systems  In  R($)  can  be  passive  by  virtue  of  (2.6). 

In  particular,  GeR(s)™  Is  passive  If  G(s)  is  positive  real.  The  transfer 
function  matrix  G(s)  Is  positive  real  if:  (1)  it  has  no  poles  in  Re(s)  >  0, 
(11)  poles  on  the  ju  axis  are  simple  with  a  non-negative  residue,  and  (111) 
for  any  u  e  R  not  a  pole  of  G(ju)  +  G(-ju)'  >  . 
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2.4  Model  Error 


The  cornerstone  of  robust  control  design  Is  a  quantifiable  bound  on  the 
error  between  the  model  used  for  control  design  and  the  actual  plant  to  be 
controlled.  In  the  adaptive  control  case  considered  here  the  model  Is  a 
parametric  model,  where  the  parameters  are  not  known  exactly.  The  structure 
of  the  parametric  model  can  be  obtained  analytically  from  physical  laws,  but 
this  Invariably  results  In  a  complicated  model.  Often  a  simple  structure  is 
selected  because  It  is  more  convenient  for  analysis  and  synthesis. 

Let  P  denote  the  plant  to  be  controlled.  In  the  broadest  sense  P  is  a 
relation  in  L1?  x  l”e  ,  l.e.,  the  set  of  all  possible  ordered  pairs 

(u.y)eL1!1  x  L,  of  Inputs  u  e  L?  and  outputs  yeL?  that  could  be  generated 
le  le  le  le 

by  the  plant  [18].  The  uncertainty  In  the  plant  is  denoted  by  (u,y)  e  P  . 


Let  P  :L 


denote  a  parametric  model  of  the  plant  P  with 


parameters  a  e  R*  •  The  parameters  can  be  selected  so  as  to  minimize  any 
discrepancies  between  the  model  and  the  plant,  i.e., 


tnf  ly-P^U' td  =  iy-P.»«Tp 
aefT 


(2.9) 


We  will  refer  to  0*ck  as  the  tuned  model  parameters  and  to  P  *  P*  as  the 
tuned  parametric  model  of  the  plant.  In  general,  P*  is  dependent  on  the 
Input/output  sequence. 

Most  of  the  previous  work  on  adaptive  control  deals  with  the  case  where 
for  every  (u,y)  e  P  there  exists  a  tuned  parametric  model  P*,  such  that 
P**P.  In  this  paper  we  consider  the  presence  of  unmodeled  dynamics,  thus, 
the  uncertain  plant  P  cannot  be  perfectly  modeled  by  any  parametric  model 
P  .  Since  we  will  deal  exclusively  with  LTI  plants  P  e  R(s)nxm  ,  It  Is 

CL 

convenient  to  describe  this  model  error  In  the  frequency-domain.  Let 
B^(r)  denote  a  "ball"  In  S  of  radius  r,  defined  by 


B$(r)  :■  {G  e  SnXI"|  7[G(ja>)]  <  r(«),  u>  e  R} 


(2.10) 
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Let  the  plant  to  be  controlled  be  described  by 


P  ■  (I  +  a)P* 


(2.11a) 


where  p  e  R( s) nxm  is  the  plant,  p*  e  R(s)nxm  is  the  tuned  parametric  model, 
and  a  e  $nxn  denotes  the  unmodeled  dynamics.  Further,  the  only  knowledge 
available  about  a  is  that  it  is  bounded  such  that 

A  e  B  («)  (2.11b) 

where  5 (u>)  Is  known  for  all  frequencies.  In  other  words,  while  the  operator 
A  is  not  precisely  known,  we  do  know  a  bound  on  its  effect.  This  model 
description  (2.2)  is  used  throughout  the  paper  to  precisely  define  the  plant 
to  be  controlled  in  an  adaptive  system.  Following  Doyle  and  Stein  [16]  we 
will  refer  to  (2.11b)  as  an  unstructred  uncertainty.  Note  that  although  a  is 
stable,  P  and  P*  need  not  be  stable.  Hence,  the  parametric  model  is 
implicitly  required  to  capture  all  unstable  poles  of  the  plant.  Although  this 
Is  not  severly  restrictive  -  at  least  on  practical  grounds  -  nonetheless.  It 
can  be  eliminated  by  definng  model  error  as  (stable)  deviations  in  (stable) 
coprime  factors  of  the  plant  [23].  As  the  subsequent  analysis  is  not 
substantially  effected  by  this  choice,  we  will  remain  with  (2.11)  for  purposes 
of  Illustration. 

2.5  Persistent  Excitation 

From  [31],  a  regulated  function  F(.)  =  R+  +  Rnxm  is  persistently 
exciting,  denoted  F  e  PE  ,  if  there  exists  finite  positive  constants 
and  such  that 

s+ot3 

a,  I  >  /  F{ t)F( t) 1 dt  >  a.  I  ,  ¥  s  e  R  (2.12) 

c.  n  s  In  + 

The  usefulness  of  a  persistently  exciting  signal  is  in  establishing  the 
exponential  stability  of  the  following  differential  equation  which  arises  in 
many  adaptive  and  identification  schemes,  i.e., 


r« 

p  ,• 

W  “ 


x  *  -8FHF'x  +  w  , 


x(0)  e  Rr 


(2.13) 


It  Is  shown  In  [31]  that  If  B  s  Rnxm,  B  *  B'  >  0  ,  He  SPR™  or  SPR+,  and 
F  e  P£  ,  then  (w,  x(0 )  { — ►  x  is  exponentially  stable,  1.e.,3m,  \  >  0  such 


a 


|x(t)l  <  me’*1*  ) x( 0 > |  +  /  me”^  (w(t)ldT  • 


(2.14) 


We  will  util l2e  this  latter  result  In  section  IV  in  our  proof  of  stabllty  of 
the  adaptive  system. 


i 


§ 


3.  ADAPTIVE  ERROR  MODEL 

In  this  section  we  develop  a  generic  adaptive  error  model  which  will  be 
used  In  the  subsequent  analysis.  This  requires  defining  the  notions  of  robust 
control  and  tuned  control . 

Robust  and  Tuned  Control 

Consider,  for  example,  the  model  reference  adaptive  control  (MRAC) 
depicted  In  Figure  3.1,  consisting  of  the  uncertain  plant  P,  a  reference  model 

A  A 

Hr,  and  an  adaptive  controller  C(e)  ,  where  a  is  the  adaptive  gain  vector,  r 
Is  a  reference  input,  d  Is  a  disturbance  process,  and  n  is  sensor  noise. 

Denote  by  H(a)  the  closed-loop  system  relating  the  external  Inputs  w  =  (r1, 
d',  n ' ) *  to  the  output  error  e,  as  depicted  in  Figure  3.2..  Also,  let  w  e  W 
denote  the  admissable  class  of  Input  signals. 

The  objective  of  the  adaptive  controller  Is  twofold:  (1)  adjust  e  to  a 
constant  a*  e  Rk  such  that  H(a*)  has  deslreable  properties;  and  (2)  during 
adaptation,  as  a  is  adjusted,  the  error  is  well  behaved.  In  the  usual 
formulations  [7]  only  (1)  Is  considered  and  further  it  Is  assumed  that  there 
exl sts  a  matched  gain,  denoted  by  T  e  Rk  .  such  that 


H(F)  =  0 


(3.1) 


The  presence  of  uncertain  unmodeled  dynamics  In  the  plant  eliminate  the  chance 

of  satisfying  the  matching  condition.  Thus,  it  is  more  appropriate  to  define 

1# 

a  tuned  gain,  denoted  by  9*  e  R  ,  corresponding  to  each  (u,y,w)  e  P  x  W  , 
such  that 


H(9*)w  <  H(e)w  ,  V  9  e  R* 


(3.2) 


The  error  signal  e*  :=  H(g*)w  Is  referred  to  as  the  tuned  error.  Note  that 
each  (u,y,w)  e  P  x  W  engenders  a  possibly  different  9*  .  Also,  it  is 
Important  to  distinguish  the  tuned  gain  9*  ,  from  the  robust  gain  9q  e  Rk  , 
where 


sup  H(eJw  <  sup  H(e)w  ,  V  9  e  R 
P  x  W  0  P  x  W 


(3.3) 


The  error  signal  e  :*  H(e  )w  Is  referred  to  as  the  robust  error.  It  follows 
o  o  -  -  -  — 

from  these  definitions  that  the  tuned  error  Is  always  smaller  In  norm  than  the 
robust  error,  thus  V  w  e  W  , 

e*  =  H{e*)w  <  e,,  *  H(q  }w  ,  (3.4) 

^  o  o 

The  tuned  controller  Is,  unfortunately,  unrealizable  since  it  requires  prior 
knowledge  of  the  actual  system  H( 9 )  (or  equivalently,  the  plant  P)  and  the 
input  w.  A  practical  adaptive  controller  is  likely  to  have  a  larger  error 
norm. 

Structure  of  the  Adaptive  Control 

In  summary,  we  consider  the  multivariable  adaptive  system,  shown  in 
Figure  3.2,  and  described  by 

e  =  H(9)w  .  (3.5) 

where  e(t)  e  Rm  is  the  error  signal  to  be  controlled,  w(t)  e  Rq  is  the 

external  input  restricted  to  some  set  W,  and  a ( t)  e  Rk  is  the  adaptive 

gain.  The  class  of  adaptive  controllers  considered  here  are  such  that  the 

1/ 

adaptive  gains  multiply  elements  of  Internal  signals  z(t)  E  R  ,  referred  to 
as  the  regressor,  to  produce  the  adaptive  control  signals, 

A  * 

f1  *  Z.J  ,  1  e  [l,m]  (3.6) 

where  9^  and  z^  are  k^ -dimensional  subsets  of  the  elements  In  g  and  z, 
respectively.  Thus, 

m 

k  a  E  k  (3.7) 

1=1  1 

Oef 1 ne  the  adaptive  gain  error, 

9 ( t)  :=  e(t)  -  8*  (3.8) 

where  8*  e  R  Is  the  tuned  gain  (3.4).  Also,  define  the  adaptive  control 
error  signal s, 


i 


.v 


a 


%  , 
V, 


v 

M 


& 


s 


:*  9}  z^  ,  1  a  1,  ....  m 


(3.9) 


An  equivalent  expression  Is, 


V  =  Z  '  9 


(3.10a) 


where  the  time-varying  matrix  Z  is  defined  by 


Z  *  block  diag(zlf  z2 . z*,) 


(3.10b) 


To  describe  the  relations  among  the  signals  e,  z,  v,  and  w  we  Introduce 
the  interconnection  system  Hj  :  (w,v  )  ♦  (e,z)  ,  as  shown  in  Figure  3.3.  In 


particular,  let  Hj  e  R( s) ^rn+l(^x^m+9)  >  and  where  Hj  is  defined  by. 


Hew  \  /  -Hev 


(3.11) 


H  /  \-H 
zw  '  zv 


In  effect,  this  structure  serves  to  Isolate  the  adaptive  control  error  v,  from 
the  rest  of  the  system.  When  the  adpative  control  is  tuned,  9  =  0  and  v  =  0; 
consequently,  the  tuned  error  signal  (3.4)  is, 


e.  :*  H( 9 . )w  =  H  w 
*  *  ew 


(3.12) 


We  can  also  define  a  tuned  regressor  signal, 


z*  :=  H  w 
*  zw 


(3.13) 


In  general,  all  the  subsystems  in  Hj  are  dependent  on  the  tuned  gains  9* 


The  interconnection  system  can  also  be  written  as, 


***.  ***.  •* 


.  V-'.V  •  -•« 
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Figure  3.3  Interconnection  Structure 


( 


with  v  given  by  (3.10).  To  complete  the  error  model  requires  describing  the 
adaptatlve  algorithm,  l.e.,  the  means  by  which  e(t)  Is  generated.  We  will 
consider  two  typical  algorithms.  A  constant  gain  (gradient)  algorithm  [7]: 


e  3  r  Z  e 


(3.15) 


where  r  e  R*x  ,  r  3  r1  >0  ,  and  a  similar  but  nonlinear  gain  algorithm: 


9  3  r(Ze  -  p ( 9 ) 9 ) 


(3.16a) 


where  p  :  (T  ♦  R+  Is  a  retardation  function,  whose  purpose  Is  to  prevent 
e  from  growing  too  quickly  In  certain  situations.  Although  many  functions 
will  suffice  we  will  select  the  one  proposed  in  [24],  namely: 


p  ( 9 )  :  = 


[■81 /c  -  1)  ,  191  >  c  maxj9*a 


(3.16b) 


,  198  <  C 


The  complete  adaptive  error  system,  Is  shown  In  Figure  3.4.  Note  that 
the  error  system  Is  composed  of  two  subsystems:  a  linear  subsystem  and  a 
non-linear  subsystem  z^  . 
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4.  CONDITIONS  FOR  GLOBAL  STABILITY 


V” “  1  -  -  •  " 


B 


3 


fci 


The  theorems  stated  below  give  conditions  for  which  the  adaptive  error 
system  (Fig.  3.4)  is  guaranteed  to  have  certain  stability  and  performance 
properties.  Proofs  are  given  in  Appendix  A.  Heuristically ,  however,  the 
basis  for  the  proofs  is  application  of  the  Passivity  Theorem  ([19],  pg.  182). 
It  turns  out  that  the  map  e  +  v  is  passive.  Thus,  if  Hgv  is  SPRm  ,  then 
the  map  e*  +  (e,v)  is  L2-stab1e  even  though  z  and/or  9  can  grow  without 
bounds.  Further  restrictions,  provided  below,  cause  8  and  z  to  be  bounded. 
(We  use  the  notation  "x  +  0  (exp.)11  to  mean  that  x(t)  +  0  (exponentially)  as 
t  +  «  . ) 


Theorem  A:  Global  Stability 


For  the  adaptive  error  system  shown  in  Figure  3.4,  assume  that: 
(Al)  The  system  is  well -posed  in  the  sense  that  all 


inputs  w  e  W  produce  signals  e.v,z,  9  ,  and 


*  in  L-e  • 

(4.1a) 

(A2) 

„  ckxm 

Hzv  e  So 

(4.1b) 

(A3) 

Hev  e 

(4.1c) 

Under  these 

conditions: 

(i) 

If  («,,  e.)  s  L™  nL;  f-»  e*  — ►0) 

and  (z*,  z*)  e  L^  then  with 

algorithm  (3.15)  or  (3.16): 

(i-a)  (9,0)  e  L*,  9  e  Lg  H L^  ,  and  9  -►  0.  (4. a) 

(i-b)  e  e  L2nL!=  *  e  L!!’  and  e"e*  -*°‘  (4.2b) 

( 1  -c )  v  £  L^n  Lm  ,  V  e  Lm 


,  and  v  -►  0  . 


(4.2c) 


(1-e) 


If,  in  addition,  e*  s  0  (matched)  and  z*  e  PE  then 
(8,  9,  e-e*.  v,  z-z*)  — 0  exp. 

(4.2e) 


(11)  If  (e*,  e*)eL^  and  (z*,  z*)  e  L*  ,  then  with  algorithm  (3.15): 


( ii-a)  z  e  Lk  (4.3) 

oo 

(11 -b )  With  the  addition  of  either  algorithm  (3.16)  or  z  e  PE  it  follows 
that  the  elements  of  a,  8,  e,  e,  v,  v,  and  z  are  in  Lb  . 

(4.4) 


Theorem  IB:  Global  Stability 

Replace  (A3)  in  Theorem  1  by 

(A3)'  Hgv  e  SPRg  '  (4.5) 

(1)  If  (e*,  e*)  e  Ljni/J  (o  e*  — ►O)  ,  and  (z*.  2*)  e  then  with 
algorithm  (3.15)  or  (3.16) 

(1-a)  (8,  9  )e  l*  ,  9  S  L^ni^  ,  9-^0  (4.6a) 

(i-b)  e  el?  H  Lm  ,  e  e  Lm  ,  e  -  e*-*0  (4.6b) 

t  00  OB 

(1-0  ( v , v)  e  Lm  (4.6c) 

a 

(1-d)  ( z , z)  e  L*  ,  (z-z*.  z-z*)  e  IjH  L*  , 

and  z-z^ — ►O  .  (4.6d) 


(1-e)  If,  In  addition,  e*  *  0  (matched)  and  z*e  PE  , 

then  (9,  v)— ►O  exp.  (4.6e) 


I 


P 


•i  >; 


E 


6  3 


(il)  If  (e*,  e*)  e  Lm  and  (2*,  i*)  e  lk  ,  then  with  algorithm  (3.15): 

•  00 


V 

(11  -a)  2e  L 

00 

(4.7d) 

>; 

(ii-b)  With  the  addition  of  either  2ePE  or  algorithm  (3 

.16),  the 

% 

. 

* 

*  ^ 

elements  of  e,  9,  e,  e,  v,  v  ,  and  2  are  in  L^. 

M 

/ 

V. 

(4.7b) 

* 

*  Corollary  1 

Performance  Bounds 

"a 
•*  ^ 

Suppose  z*  and  e*  satisfy  the  conditions  in  (i)  of  Theroems  1A 

or  IB. 

r 

A 

.*  1 

«■ 

(1) 

Let  Hgv  e  SPRJJ  ,  i.e.,  3  u,  Y  >  0  such  that  Vu»eR  , 

A 

.s 

A 

« ■ 

■>, 

V, 

w  J 

aCHev(ju,)]  <  Y  and  ^{Hev( j<u)  +  Hev(-Jo»)  ’  ]  >  u  Im 

(4.8a) 

3 

Then,  bounds  on  iei.  and  a  a  a  can  be  obtained  from: 

d  oo 

I 

ie-e*a2  <  [ie*i2  +  (ie*i|  +  2U  9(0)’  r-1 9 ( 0 ) ) 1 /2 ] 

n 

(4.8b) 

5 

10 ,r“19i—  <  9(0)'  r_19(0)  +  2iei2«e-e*i2/Y 

J-1 

(4.8c) 

\ 

1 

*  * 

(il) 

Let  H0V  e  SPRg  ,  i.e.,  3u.  d.  k  >  0  such  that  iluefl 

> 

i 

^{Hev(ja»)  +Hev(-ju»)']  Hey  ( -  ja» )  ’  H  ev  ( j  a> ) 

s 

(4.9a) 

* 

* 

|{Gev(jco)  +  Gev(-jo»)']  >  k  Im 

(4.9b) 

? 

V. 

Gev(s)  :=  {1  +  qs)  Hev(s) 

(4.9c) 

a 

k 

'  1 

1 

v* 

V 

Then,  bounds 

on  ie,i  and  a ea  can  be  obtained  from: 

C  oo 

,e,2  <  +  (»e*+qe*i2  +  2k2u8(0)’r“l9(0))1/2] 
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'r  ^9i—  <  e(0) 'r  *9(0)  +  y  je*+qe*a2»e«2 


(4.9d) 

(4.9c) 
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Discussion 


(1)  Theorems  1A  and  IB  give  conditions  under  which  the  adaptive  error 
system  Is  globally  stable.  Essentially,  conditions  are  Imposed  on  the 
Interconnection  subsystems  In  Hj  .  In  particular,  Hgv  e  $PRm  and 

H  y  e  SgXm  are  direct  requirements,  whereas  the  restrictions  on  the  tuned 
signals  e*  and  z*  ,  Indirectly  Impose  requirements  on  Hgw  and  H  ^  .  These 
latter  requirements  are  dependent  on  knowledge  about  w  e  W  .  For  example,  if 
w  Is  a  constant,  then  the  assumption  that  e*  +  0  (Theorem  1A- 1 )  requires 
that  the  tuned  feedback  system  Is  a  Type-I  robust  servomechanism,  i.e.,  the 
transfer  junction  Hgw(0)  =  0  for  all  (u,y)  e  P  . 

(2)  Corollary  1  gives  explicit  bounds  on  signals  in  the  error  system. 

These  bounds  can  be  used  to  evaluate  the  adaptive  system  design.  Moreover, 

the  bounds  allow  a  coarse  determination  as  to  the  efficacy  of  adaptive  control 

vs.  robust  control.  8y  comparing,  for  example,  the  adaptive  error  iiei^  from 

(4.8)  with  the  robust  error  ie  i.  from  (1.5),  it  is  possible  to  obtain  a 

O  2 

quantifiable  measure  of  performance  degradation  during  adaptation. 

(3)  Although  Theorems  1A  and  IB  are  essentially  the  same,  there  are 
slight  difference  worth  noting.  These  differences  arise  because  in  1A, 

HeveSPR™3^  Hgv(s)  1s  Proper  but  not  strictly  proper,  whereas  in  IB, 
HeveSPRg=»>  Hgv(s)  is  strictly  proper.  Thus,  comparing  part  (i)  in  1A  and 
IB,  we  see  that  in  IB,  v,  v  e  Lm  whereas  in  1A,  v  is  additonally  in 

<30 

L™  and  v-^0  . 

(4)  The  use  of  persistent  excitation  or  gain  retardation  is  seen  in  part 
(ii)  of  theorems  1A  and  IB  to  provide  the  means  to  guaranty  bounded  signals. 
Other  schemes  based  on  signal  normalizations  or  dead- zones  can  provide  similar 
results,  e.g.  [32] ,[33].  The  effect  of  these  conditions  is  to  provide  an 

l  -stability  which  Is  not  present  otherwise.  The  persistent  excitation 
condition  actually  supplies  exponential  stability,  which  is  stronger  than 

l  -stability,  as  provided,  for  example,  by  the  gain  retardation  (see  proof  in 
00 

Appendix  A). 

(5)  The  persistent  excitation  requirements  in  parts  (1)  and  parts  (ii) 


are  different.  In  parts  (1),  z*ePE  ,  whereas  In  parts  (11),  zePE  .  The 
different  assumptions  arise  because  In  parts  (1)  we  enforce  the  matched 
condition  e**0  .  Hence,  z*ePE  *>  ZePE  •  This  follows  from  (1-d)  where 
z  -  z^  ♦  0  expoentlally.  Also,  with  e*  *  0  ,  a  bounded  disturbance  added  to 
the  reference  can  cause  z  e  PE  without  forcing,  e.  e  L  .  In  parts  (11), 
which  Is  more  realistic,  we  disallow  the  matched  condition,  and  hence, 
e*  e  L  .  Thus,  z  e  PE  Is  the  weakest  assumption  to  make.  However,  since  z 

a* 

Is  Inside  the  adaptive  loop,  it  Is  very  different  to  guarantee  z  e  PE  by 
Injecting  external  signals.  Note  also  (in  both  parts(ll))  that  without 
retardation  or  PE  it  Is  possible  for  the  regressor  to  remain  bounded  even 
though  the  adaptive  parameters  may  grow  unbounded.  Similar  results  have  been 
reported  elsewhere,  e.g.  [24]. 

Robustness  to  Unmodeled  Dynamics 

Since  the  theorems  Impose  requrlements  on  the  input/output  properties  of 

the  Interconnection  system,  it  follows  that  the  effect  of  model  error  on  these 

properties  determines  the  stability  robustness  of  the  adaptive  system.  For 

example,  both  theorems  require  that  Hgy  e  SPRm  .  Suppose,  however,  that 

H  has  the  form, 
ev 

Hev  '  (!  *  VWev  (4-101 

where  Hgy  is  the  projection  onto  Hgv  of  the  plant  uncertainy  operator  a  ; 

and  Hgv  Is  the  nominal  transfer  function  when  there  is  no  uncertainty,  l.e., 

when  a  *  0  .  Thus,  }T  Is  a  function  of  the  tuned  parametric  model  P*  and 

ev 

the  tuned  controller  gains  9*  .  (See  Section  V  for  more  specific  formulae, 
e.g.  (5.5).) 

Conditions  to  Insure  that  Hgy  s  SPR+  despite  uncertainty  In  Hev  is 
provided  by  the  following: 

Lemma  4.1:  Let  Hev  be  given  by  (4.3).  Then  Hgy  e  SPR+  if  the  following 
conditions  hold: 

(1)  H  e  SPRm 
ev  + 
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(4.11a) 


(4.11b) 


fa 

i  J 


V* 


i 


c 


i 


• 

a 


y. 


V 

V 


t  m 

s 


Hi)  fleye  Bg(lc)  where  V  w  e  R  , 
k(«u)  <  jX[Hev(j«)  +  Hev(-j«),]/7[Hev(j«)]  (4.11c) 

Proof:  Define  L(.):  Cmxm  *  R  by 

jj_  ( A)  3  X_(  A+A  ) 

where  *  denotes  conjugate  transpose.  Then,  using  definition  (2.8)  with  (4.10) 
-  (4.11)  we  obtain 

ji[Hev(ja>)]  3  u[Mev(jui)  +  ^ev(jw)Hev(ju)] 

>  u[Hev(j<*>)]  -  o^yU^R^Uw)]  >  0  • 


Hnece,  H^e  SPR+  . 

Comments 

(1)  In  order  to  apply  Lemma  4.1  it  is  necessary  to  have  a  detailed 
description  of  how  the  plant  uncertainty  &  propagates  onto  the 
interconnection  uncertainty  H  .  This  type  of  uncertainty  propagation  was 
explored  in  depth  by  Safonov  [25]  and  more  sophisticated  expressions  then 
(4.4b)  are  available  to  describe  the  uncertain  operator  Hey  .  Section  5 
contains  more  detail  on  this  issue. 


(2)  In  the  scalar  case  (4.11c)  becomes 


*(«)  <  Re[Hev(ju)]/|Hev(ju»)| 
3  cos  *  [Hev(jo))] 


< 

(4.12) 


Since  H  e  SPRm  by  assumption,  k(<*» )  is  always  positive  for  u»  e  R  ;  but 
ev 

because  of  the  cosine  function,  k(w)  <  1  .  In  Section  6  we  show  that  this 
limitation  on  the  effect  of  model  error  is  easily  violated  by  even  the  most 
benign  type  of  unmodeled  dynamics  in  the  plant.  Methods  which  overcome  this 
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limitation  are  discussed  in  Section  7.  The  requirement  that  k(w)  <  1  also 


holds  for  any  multivariable  Hgv  e  SPR 
decomposition. 


H  =  G  W  =  W  G 
ev  4  ev  ev  r 


To  see  this  let  H-  have  the  oolar 
ev 


(4.13) 


where  G  .  Gr  are  Hermltlan  and  Wev  Is  unitary. 


Since 


F(H  )  3  alG  )  *  oTG  ) 
e*  i  r 


it  follows  that 


k(w)  <  a[ wev( joi ) ]  <  1 


(4.14) 


In  the  case  of  scalar  systems,  the  condition  k(u>)  <  1  can  be  interpreted  in 

terms  of  a  limitation  on  relative  degree  of  Hgv(s)  •  A  necessary  condition 

for  H  e  SPR  Is  that  the  relative  degree  of  H  (s)  does  not  exceed  one 
ev  ev 

i.e.,  phase  limited  to  ±90°.  Rohrs,  et  al .  [12]  show  that  this  necessitates 
precise  knowledge  of  plant  order,  and  hence,  is  not  a  feasible  requirement  in 
the  presence  of  an  unstructured  uncertainty  (2.12),  where  the  order  Is 
unknown.  In  the  multivariable  case  It  is  awkward  to  talk  about  relative 
degree  or  phase,  however,  (4.14)  expresses  the  same  limitation. 

(3)  In  several  Instances,  e.g.,  [9], [26], [27],  it  has  been  reported  that 
the  SPR  condition  has  been  eliminated.  In  each  case,  however,  it  can  be 


verified  that  the  operator  H 


positive  constant  ,  which  is  SPR.  But, 


these  studies  do  not  account  for  unmodeled  dynamics,  thus,  in  the  notation  of 
(4.10),  only  TT  a  positive  constant  .  Lemma  4.1  then  provides  the  means  to 
evaluate  the  effect  of  unmodeled  dynamic. 
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5.  APPLICATION  TO  MODEL  REFERENCE  ADAPTIVE  CONTROL 


Consider  the  model  reference  adaptive  control  (MRAC)  system,  shown  In 

Figure  5.1,  consisting  of:  an  uncertain  scalar  plant  P  e  Rq(s)  ;  a 

reference  model  H  e  S.  ;  and  filters  with  F  e  $£x*  •  The  plant  Is 
r  u  u 

affected  by  a  disturbance  d  and  a  reference  command  r.  The  system  eauatlons 
are: 


e  =  y  -  y_ 


(5.1a) 


v” 

’  4 

y 

*  H  r 

(5.1b) 

ml 

Jr 

r 

\  4 

y 

3  d  +  Pu 

(5.1c) 

£ 

£ 

u 

=  -  8  'z  =  -<0{z1  +  9^2 ) 

(5. Id) 

Z1 

=  F  u,  z2  *  F(y-r) 

(5.1e) 

Assume  that  the  adaptive  law  Is  given  by  (3.15),  thus, 


8  =  r  z  e 


(5. If) 


Let  the  plant  uncertainty  be  described  by (2.12),  i.e., 

P-P* 


A  :*  -5 —  e  BCU) 


( 5 .  lg ) 


where  P*  e  R  (s)  is  a  tuned  parametric  model  for  P.  Let  the  filter  dynamics 
*  o 
be  given  by 


1  s  s1’1 

F(s)  ’  iUTf  ’  UTsT  *  HIT  y 


( 5 . lh ) 


where  L(s)  Is  a  stable  monlc  polynomial  of  degree  i  .  Thus, 

( t) ,  e2(t)  e  Ra  and  so  e(t)  e  R2*  .  Using  the  definition  of  tuned  gain 
(3.2)  we  get, 


,'j 


-  9  Z  *  -l9*+9 )  z 

■(0*1Z1  +  9*2Z2}  *  v  ’  v  :5 
^*1  ^*2 

-  -pi.  U  +  —r—  (r-y)  -  v 


a'z  from  (3.6) 


Finally, 


u  ■  (r-y 1  -  rnqx v c*{r-yl  - 


(5.2) 


where  A*  and  ^  are  p0-| ynoml al s »  each  of  degree  £-1  ,  whose  coefficients  are 
the  elements  of  the  tuned  gains  9*^  and  9*2  *  respectively;  and  C*  denotes 
the  tuned  controller.  The  tuned  system  (  9=0  )  is  shown  in  Figure  5.2. 

In  terms  of  the  uncertain  plant  P,  the  adaptive  error  system  (Fig.  3.4) 
corresponding  to  this  MRAC  system,  has  tuned  signals: 


e*  ■  (1  +  PC*)"1d  +  [(l+PC*)-1PC*-H  ]r 


F( 1+PC*)_1C*( r-d) 


F(1+PCJ  ( d-r) 


(5.3a) 


(5.3b) 


and  Interconnections: 


Hev  *  (I+PCJ’Wa^/L)'1 


(5.3c) 


,v 

< 


H  * 
zv 


F(  1+PC*)_1(  I+A^/l)”1 
Fd+PCj^Pd+A^/L)"1 


:5.3d) 


The  error  system  can  also  be  described  so  as  to  highlight  the  model  error 
The  following  definitions  are  convenient: 


T*  :*  (l+P^Cj’^C*  :•  I  -  S* 


(5.4a' 


K*  :=  Hi  *  (1+P*C*)’1P*(1+A*1/L)‘1 
ev,A=0  1 


(5.4b) 


Thus,  the  error  system  (5.3)  can  be  also  be  expressed  as: 


e*  =  S*(l+AT*)_1d  +  (T*( 1+a)( 1+aT*)-1-H  )r 


(5.5a) 


•  F  S*C*(l+AT*)"1(r-d) 


F  S*(1+aT*)  ( d-r) 


) 5 , 5b ) 


Hev  »  K*(1+a)(1+aT*)_1 


(5.5c) 


F  KJ^tl+AT*)"1 


F  K*(1+a)(1+aT*)' 


(5.5d) 


The  result  that  follows  In  Lemma  5.1  gives  conditions  under  which 

H  e  SPR  and  H  e  S^ixl  ,  despite  model  error;  thus  conditions  (AIM A3) 
ev  o  zv  o 

of  Theorems  1A  and  28  are  satisfied.  Additional  requirements  are  necessary  to 
establish  the  class  of  tuned  signals  e*  and  z*  as  given  by  (5.5a)  and  (5.5b), 
respectively.  These  requirements  are  discussed  following  Lemma  5.1. 


Lemma  5.1;  For  the  adaptive  system  (5.3)  or  (5.5)  H  e  SPR  and 

- __  J  ev  o 

H  e  S<i4Xi  IT  the  following  conditions  are  all  satisfied; 
zv  o 


(1)  P*(s) 


g(sn-1+  s1sn_2+  ...  +  s  n>>1 )  gN*(s) 


s  +ais  ♦  ...  +  an 


UTTsT" 


(5.6a) 


(11)  N^s)  is  a  stable  monic  polynomial 


(5.6b) 


(ill)  g  >  0 


(5.6c) 


g  K,(s) 

( 1  v)  k*(s)  *  ■|<^sy -  S  SPRq  where  Kj(s)  and  K2(s)  are  monic  stable 


polynomials. 


(5.6d) 

(5.6e) 


Proof:  See  Appendix  8. 

Discussion 

(1)  Condition  (1)-(v)  of  Lemma  5.1  are  restatements  of  known  results, 
but  normally  they  apply  to  the  actual  plant  P,  e.g.  [7].  In  Lemma  5.1, 
however,  these  conditions  apply  to  the  parametric  model  P*  —  not  to  the 
actual  plant.  As  such,  they  are  easier  to  satisfy,  since  the  parametric  model 
Is  somewhat  arbitrary.  This  flexibility  is  penalized  by  an  increase  In  model 
error.  For  example,  If  the  actual  plant  has  a  relative  degree  of  2,  then 
choosing  a  parametric  model  of  relative  degree  1  —  as  required  by  condition 
(1)  —  incrases  the  high  frequency  model  error. 

(2)  Condition  (vi)  imposes  an  upper  bound  T  on  the  model  error 
associated  with  the  chosen  parametric  model.  This  condition  simultaneously 
insures  that  Hgy  e  SPRQ  despite  model  error,  and  that  the  tuned  system  is 
stable  (see  proof  in  Appendix  B). 

(3)  It  is  easily  verified  that  Ttm)  <  1  ,  as  was  discussed  following 
Lemma  4.1.  In  fact,  even  the  "optimally  tight"  bound  (see  [25]  for  details  on 
this  calculation)  given  by, 

T  *  7JTW  H1'11  +  ( |1+T|2  +  4q  Re(KT/|K|)1/2]  (5.7) 

is  also  restricted  to  be  less  than  1.  This  limitation  severely  restricts  the 
type  of  admissable  model  error.  This  issue  is  pursued  in  Section  6. 
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(4)  To  guarantee  global  stability 
property  (i)  of  Theorem  1  requires  that 
and  d.  For  example,  let  r  and  d  be  any 
r  constant  and  d  -►  constant  as  t  • 
satisfied  if: 


using  the  adaptive  law  (5. If), 
e*  -*■  0  and  z*,  i*  e  for  all  r 
bounded  signals  such  that 
.  Property  ( i )  of  Theorem  1  1 s 


5(0)  =  0 


(5.8a) 


TJO)  »  H  (0)  -  1  (5.8b) 

r 

Zero  model  error  at  0C  (5.8a)  is  certainly  to  be  expected  from  even  the  most 
crude  tuned  parametric  model. 


(5)  Let  r  be  bounded  such  that  r  +  constant  as  t  +  «  ,  but  let  d  be 
just  bounded,  i.e.,  d  e  .  In  this  case  it  Is  not  possible  to  guarantee 

e .  0  ,  but  we  can  guarantee  that  e*  e  L  •  To  obtain  global  stability  in 

"  "  go 

this  case,  requires  the  introduction  of  the  retardation  term  (3.16)  into  the 
adaptive  law  (5. If),  see  part  ( 1 i )  of  Theorems  1A  or  18. 

(6)  It  is  possible  to  obtain  versions  of  Lemma  5.1  for  adaptive  systems 

of  different  forms,  e.g.,  indirect  adaptive  [5].  Also,  the  use  of 

"multipliers",  e.g.  [4],  can  be  accounted  for  as  well.  The  multiplier 

* 

effectively  makes  use  of  the  availability  of  9  as  a  signal;  and  this  allows 
rel  deg  (P*)  3  2  rather  than  1  as  required  by  condition  (i)  of  Lemma  5.1. 


6.  LIMITATIONS  IMPOSED  BY  THE  SPR  CONDITION 


The  fact  that  the  model  error  bound  given  In  condition  (vi)  of  Lemma  5.1 
can  not  exceed  one  has  unfortunate  consequences. 

Example  1 


Consider  a  plant  with  transfer  function, 

P(s)  =  P*(s)  ( s+aK's'+tiT  (6,1) 

where  P*  Is  the  parametirc  model,  with  two  unmodeled  stable  poles  at  -a  and 
-b.  Suppose, also,  that  b  is  much  greater  than  a,  and  that  a  is  much  greater 
than  the  bandwidth  of  P*(s)  .  This  situation  seems  benign  —  and  most  likely 
a  certainty.  Comparing  (6.1)  with  ( 5 . lg)  gives, 


6  ( to ) 


r  oi2+  (a+b)2  ,1/2  ^  . 

“L -  >  1 

,  2x  2, .2  2, J 

(o)  +a  ){'ji  +b  ) 


for  all  frequencies  u  >  (a b/2 ) 1 ,  thus,  condition  (vi)  of  Lemma  5.1  is 
violated,  and  global  stability  cannot  be  guaranteed.  The  following  example 
illustrates  this  point. 


Example  2 


Consider  the  example  MRAC  system  (Fig.  5.1)  studied  by  Rohrs  et  al .  [12], 
where: 


P(s) 


2  229 

S+1  ( s+15)2  +  4 


hR(s)  a  FT 

A  A 

u  =-81y  +  92r 


c 


®1  *  ye’  *  ,65 

92  *  -r  e,  0 2( 0)  =  1.14 

Let  r  *  constant  and  d  *  0.  Thus,  e*  +  0  exponentially  when  the  tuned  gains 
are  such  that  (5.8)  Is  satisfied,  i.e., 

T*,0)  'T^7*  Hr(0>  ■  1 

Even  though  (0*.,  0*-)  exist  to  satisfy  this,  H  (s)  is  not  SPR,  and  so 
l  £.  ev 

global  stability  Is  not  guaranteed.  Simulation  runs  with  r  a  .4  and  r  a  4.0 
are  shown  in  Figures  6.1  and  6.2,  respectively.  With  the  small  Input  (Fig. 
6.1)  we  see  a  stable  response  which  tracks  the  reference  very  well.  With  the 
large  input  (Fig.  6.2)  the  response  Is  still  stable,  but  large  oscillations 
are  taking  place.  Larger  Inputs  will  eventually  drive  the  system  unstable, 
e.g.  [12]. 

In  this  example,  If  the  tuned  model  Is  taken  to  be  P*(s)  =  l/(s+l)  then 
it  is  easily  verified  that  model  error  <s(u>)  is  greater  than  one  at  some 
frequency. 


S' 


7.  SPR  COMPENSATION 


In  this  section  we  heuristlcally  develop  a  means  to  obtain  global  robust 
adaptive  control.  Since  the  SPR  condition  Is  violated  whenever  model  error 
exceeds  one,  a  natural  scheme  Is  to  construct  an  SPR  compensator  which 
allelvates  the  problems  by  "filtering"  the  plant  output;  thus,  avoiding  the 
trouble.  However,  direct  filtering  does  not  change  the  size  of  model  error. 
For  example,  with  the  plant  p  *  (1+a)P*  .  let  yw  denote  the  output  of  the 
filtered  plant,  where 


y  :*  Wy  =  Wd  +  (1+a)WP.u 

w 


(7.1) 


Thus,  model  error  is  uneffected.  Even  filtering  directly  by  W  offers  no 
help,  since  the  bound  (4.4c)  is  still  less  than  one,  i.e., 


|Hevl  <  Re(W  ffev)/|W  JTevl  <  1 


(7.2) 


for  any  stable  W.  What  we  seek  is  an  SPR  compensator  which  only  effects  the 
unmodeled  dynamics,  but  leaves  the  paramtric  model  intact. 

A  compensation  scheme,  which  offers  some  promise  as  an  SPR  compensator. 

Is  that  proposed  in  [22],  as  shown  in  Figure  7.1.  To  see  the  desired  result 

suppose  that  P  *  ^+Alpm  a  e  8^(5)  .  Then,  the  compensator  is 

equivalent  to  a  plant  which  maps  (u,d)  Into  y  where 

c 


y  =  Wd  +  P  u 
c  c 


P  -P 
rc  rm 


e  B$(W6 ) 


(7.2a) 


(7.2b) 


Thus,  whenver  <5 (u>)  >  1  ,  select  W(s)  such  that  |w( ju) 1 6(u>)  <  1  •  The  filter 
W  acts  like  a  "frequency  switch"  whose  function  is  to  Insure  condition  (vi)  of 
Lemma  5.1. 

There  are  two  ways  to  Implement  this  compensator  in  an  adaptive  system. 

The  first  way  Is  to  use  a  fixed  model  of  the  plant  for  Pm»  i.e.,  Pm  =  P  . 

The  second  way  Is  to  replace  P  with  an  adaptive  observer,  i.e.,  p  *  p  . 

m  m 
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In  either  case,  to  obtain  the  benefit  of  the  SPR  compensator,  the  signal  to  be 
controlled  Is  the  compensator  output  y  ,  not  the  plant  output  y.  Both  of 
these  compensators  will  now  be  examined. 

Fixed  SPR  Compensator 


V, 


.v 


Let  P  *  P  ,  a  fixed  model,  and  let  the  actual  plant  be  given  by  (2.17), 
m 

P  3  (1 +a)P#  with  a  e  B 5 )  .  Then  the  fixed  compensator  plant  equivalent 
model  error  (7.2b)  is: 


Pc-P* 

ac  :*  — p—  £  85(6^ 


(7.3a) 


where 


5^(ui)  :■  |  W  ( ju)  1 5  (oj)  +  |1  -  W(jta)| 


F’f  ju>)“P*(  joj )  | 

pTTO  I 


(7.3b) 


This  scheme  Is  motivated  by  the  fact  that  at  low  frequencies  the  tuned 
parametric  model  P*  is  close  to  P;  thus  6  Is  small  and  W  «  1  .  At  high 
frequencies  <s  Is  large  but  (r  -  P*)/P*  Is  small,  W  -  0  and  so  is 

small.  Of  course  the  compensator  is  limited  if  there  is  large  model  error  at 
Intermediate  frequencies. 


G 


$ 


u* 


v; 

V. 

V 


V, 
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Example  2 


Example  1  Is  modified  to  Include  a  fixed  SPR  compsnator  with  W(s)  = 
l/(s+l)  and  Pts)  *  2/(s+l)  .  Simulation  results  with  the  large  step  command 
(r=4)  are  shown  In  Figure  7.2.  Comparing  these  to  Figure  6.2,  without 
compensation,  it  Is  readily  verified  that  the  instability  tendencies  are 
eliminated.  Also,  direct  calculations  reveal  that  e  SPRq  ,  thus  global 
stability  Is  insured. 

Adaptive  SPR  Compensation 

An  adaptive  SPR  compensator,  together  with  the  adaptive  controller,  is 
shown  In  Figure  7.3.  The  adaptive  controller  Is  described  by. 
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Fgt s)  *  (1/Lc(s) .... ,s  v  /lc(s))  ,  nc  =  deg  Lc( s ) 


and  the  adaptive  observer  Is  described  by. 


9'  zQ  ,  z'Q  =  (F'q  u.  -Fq  y) 


(7.4c) 


r.z  e  ,  e  =  y  -  y 
ooo  o 


f;(s) 


*  ( 1/LQ( s) ,  ....  s  0  /LQ(s) )  ,  nQ  =  deg  Lq(s) 


(7.4d) 


(7.4d) 


(7.4f) 


where  L  (s)  and  L  (s)  are  both  monlc  and  stable.  To  generate  the  error 
0  c 

system  Interconnection  operators  associated  with  this  system,  let  e.  and 

*c 

8.  denote  the  tuned  parameters  with  respective  gain  errors,  e  and  0  ;  anc 

0  co 

let  v  :*  e'z  and  v  :=  a'z  be  the  corresponding  adaptive  control  errors 
c  c  c  0  0  0 

(3.6).  By  analogy  with  the  procedure  used  in  Section  5  we  get, 


1  P 

5  V 


u  •  C^(r-yc)  - 


[+A^77L~ 


-  —  d  +  (1  — —  a)P*u 


(7.5) 


(7.6) 


where 


A*2/lc 


(7.7) 


n  _  Z  0 

p*  i+il. 7 r 


(7.8) 


n^o 


and  where  (A*j,  a*2)  are  polynomials  whose  coefficients  are  the  parameters  in 
9*c  *  are  Polynomials  whose  coefficients  are  the  parameters  in 

9*0  '»  and  N*,  p*  and  g  are  as  defined  by  (5.6a).  The  adaptive  error  model  is 
given  below  In  terms  of  T.,  $.,  and  K.  as  defined  in  (5.4).  In  additon, 


define: 


D* 

R  :«  1  +  (W-l)  r- 

Lo 

The  tuned  signals  are: 

e*c  *  SJI+aRT*)'^  d  +  (T*(l+aR)(l+^RT*)"1-Hr)r 

e*0  *  O^d+ART*)"^  +  D^T^U+aRT*)"^ 

FcA*2L“1P;1K*{l+ART*)‘1(r-Rd) 

Z*c  "  -1 

_FcS*(1+aRT*)  1(Rd-r) 

FoA*2Lclp*1|<*{1+ART*^1(r-Rd) 

Z*o  *  -1 

FqT*(1+aRT*)  A(d  -  (1+A)r) 

-(1-W)S*(1+aRT*)'1 
l+d-WiTJJ^L^d+ART*)"1 

FcA*2L^P*1|<*{1'W)(1+aRT*) 
-F  S*( 1-W) ( 1+aRT*)”1 


The  Interconnections  are: 

K*(1+aR) (1+aRT*)'1 

H  * 

0  V 

W^Ad+ART*)*1 

fcp;1k*(  i+art  ,rl 

Hz  V  * 

C  FK*( 1+aR)(1+aRT#)"1 


FqP*  K*( 1+aRT*)”1 
-F0K*(1+a)(1+aRT^)_1 


F0**ZlC] ?* X(1-W)(1+ART*)_i 
-F0T*(1-W)(1+a)(1+aRT*)"1 


(7.11c) 


The  factor  (1+aRT*)"*  appears  in  all  the  terms  above.  The  transfer 

function  R  (7.9)  reduces  the  effect  of  unmodeled  dynamics;  however  not  exactly 

by  the  amount  anticipated,  vis  a  vis  (7.2).  This  Is  due  to  addi tonal  model 

error  introduced  by  the  adaptive  observer.  Nonetheless,  the  model  error 

attenuation  Is  greater  than  with  the  fixed  SPR  compensator.  In  particular,  at 

low  frequencies  a  -  0  and  at  high  frequencies  R  «  0  ,  since 

W  -  0  and  D*L_1  -  1  .  Without  further  testing  of  H  (7.11a)  it  is  not 
*  o  ev 

possible  to  state  that  H  e  SPR  at  intermediate  frequencies.  Note, 

ev  o 

however,  that  the  nominal  value  of  H  is: 

ev 


TT 

ev 


-(l-W)S* 

1 


(7.12) 


which  is  SPR0  provided  that  k*  e  SPR  and 

Rc  K+(jui)  >  ^-| ( 1-W( j(i> ) ] S+(  jo) )  | ^  ,  a)  e  R  (7.13) 


Applying  (4.11)  to  (7.11a),  a  tedious  procedure,  would  give  an  upper  bound  on 
model  error  to  insure  H  e  SPR„  . 


8.  CONCLUSIONS 
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This  study  has  presented  an  Input/output  view  of  multivariable  adaptive 
control  for  uncertain  linear  time  Invariant  plants.  The  essence  of  the 
results  are  captured  In  Theorems  1A  and  2B  which  provide  conditions  that 
guarantee  global  stability.  Corollary  1  also  give  specific  Lj  and  bounds 
on  significant  signals  In  the  adaptive  control  system.  These  bounds,  for 
example,  can  be  used  to  guarantee  that  the  adaptive  system  performs  as  well  as 
a  robust  (non-adaptlve)  system  using  the  same  structure,  but  with  fixed 
gains.  By  distinguishing  between  a  tuned  system  and  a  robust  system,  we 
establish  formulae  which  can  be  used  to  restrict  the  minimum  performance 
Improvement  possible  with  the  same  control  structure. 

Although  the  stability  results  (Theorem  1A,  IB)  are  not  entirely  new  (see 
e.g.,  [7], [8]),  the  Input/output  setting  provides  the  means  to  directly 
determine  the  system  robustness  properties  with  respect  to  model  error.  The 
type  of  model  error  examined  can  arise  from  a  variety  of  causes,  such  as 
unmodeled  dynamics  and  reduced  order  modeling.  It  Is  very  difficult  to  treat 
this  type  of  “unstructured"  dynamic  model  error  by  using  Lyapunov  theory, 
since  the  system  order  may  not  be  known  —  In  fact,  It  may  be  Infinite. 
Although  Infinite  dimensional  (distributed)  systems  were  not  considered  here, 
Theorem  1  can  be  modified  to  Include  them,  e.g.,  [26]. 

The  structure  of  Theorems  1A  and  IB  require  that  a  particular  subsystem 
operator,  denoted  Hgv  ,  Is  strictly  positive  real  (SPR).  This  requirement  Is 
not  unique  to  this  presentation  -  passivity  requirements.  In  one  form  or 
another,  dominate  proofs  of  global  stability  for  practically  all  adaptive 
control  systems.  Including  recursive  Identification  algorithms. 

Unfortunately,  although  Hgv  e  SPR  Is  robust  to  model  error  (Lemma  4.1),  the 
bound  on  the  model  error  is  too  small  to  be  of  practical  use.  Even  the  most 
benign  neglected  dynamics  violate  the  bound. 

Although  this  study  Is  concerned  with  contl nuous-time  systems,  the 
theorems  carry  over  virtually  Intact  to  discrete- time  systems.  This  is  a 
direct  consequence  of  the  portable  nature  of  the  Input/output  view.  However, 
there  Is  an  Important  Issue  unique  to  discrete-time  systems:  plant 


uncertainty  Is  critical  to  where  performance  is  actually  measured,  which  is  in 
continuous- time,  not  at  the  sampled-data  points.  As  a  consequence,  it  may  be 
necessary  to  map  the  discrete  portions  of  the  adaptive  system  (most  likely  the 
controller)  into  continuous-time,  i.e.,  the  |_2*9ains  of  the  discrete-time 
operators  in  the  interconnection  map,  which  are  associated  with  the  adaptive 
discrete-time  controller,  would  be  needed  rather  the  discrete-time  tg-gains  . 

Another  area  worth  pursuing  Is  the  adaptive  control  of  non-linear 
plants.  The  plant  uncertainty  description  (2.11)  does  not  exclude  non-linear 
plants.  Note  that  slowly  drifting  parameters  in  an  otherwise  perfectly  known 
LTI  plant  could  yield  the  same  uncertainty  description  as  a  non-linear  plant 
approximated  by  a  parametric  LTI  model.  All  that  Is  required  is  that  there 
exists  a  (possibly)  Infinite  dimensional  LTI  system  which  matches  the 
input/output  bet  the  plant  for  each  possible  input/output  pair.  Of 

course,  if  the  tear,  then  the  tuned  control  is  likely  to 

be  non-linear,  which  raise*  interesting  issues  for  further  research. 

One  final  remark:  the  stability  results  presented  here,  as  well  as  other 

known  results,  provide  global  stability.  This  is  achieved  by  requiring 

H  e  SPR  ,  a  condition  which  is  difficult  to  maintain  in  normal 
ev 

circumstances.  On  the  other  hand,  this  is  a  sufficient  conditon;  violation  of 
which  does  not  necessarily  lead  to  instability.  The  simple  example  presented 
here  in  Figure  6. 1-6. 2,  illustrates  the  point.  Other  examples  of  this 
phenomena  abound,  e.g.,  [12].  It  would  appear  then,  that  a  more  valid 
approach  to  providing  a  system-theoretic  setting  for  adaptive  control  is  to 
develop  local  stability  conditions,  which,  hopefully,  do  not  require  that 
Hev  e  ^PR  *  Pre1im1nary  results  on  local  stability  supoort  this  hope,  e.g., 
[33],  [34]. 


III.  WORK  IN  PROGRESS 


The  AOCON  concept  involves  many  different  issues,  as  can  be  seen  from  the 
earlier  discussion  and  from  [36]-[38].  So  far  we  have  addressed  the  problem 
of  designing  a  controller  for  a  single  subsystem,  when  the  rest  of  the  system 
is  fixed.  This  represents  only  one  step  in  an  iterative  procedure  in  which 
each  subsystem  performs  its  own  controller  design.  We  are  currently 
investigating  extensions  of  the  theory  of  robust  control  and  adaptive  control 
to  the  case  of  interconnected  subsystems,  in  which  local  controllers  are 
designed  sequentially  (iteratively)  or  simultaneously.  A  number  of  different 
information  structures  are  being  considered.  It  seems  that  by  providing  each 
subsystem  with  structural  information  in  addition  to  an  aggregate  (reduced 
order)  model  of  the  rest  of  the  systems,  it  is  possible  to  obtain  simpler 
design  schemes. 

We  are  also  investigating  the  application  of  lattice  structures  to  the 
adaptive  control  problem.  Our  earlier  work  in  this  area  seemed  to  have 
generated  a  considerable  amount  of  interest  (cf.  [41]-[46]).  This  class  of 
algorithms  is  especially  well  suited  for  large  scale  problems  of  the  type 
considered  in  this  project. 
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APPENDIX  A 


PROOF  OF  THEOREMS  1  AND  2 

Prel Imlnarles 

The  main  Ingredient  In  the  proof  Is  to  show  stability  by  means  of 
passivity.  Although  there  are  many  variations  on  this  theme,  a  general  result 
is  given  by  the  following. 

Theorem  A.l  ([21],  [35] 

Consider  the  feedback  system  of  Figure  A.l  below  with  causal  operators 
G1  and  G2  . 


Figure  A.l  Feedback  System 

Suppose  there  exists  real  constants  e^,  5^,  ,  1=1,2  ,  such  that 

O  7 

<x,GjX>t  >  ei 11  X|  t2  +  51,G1x,t2  +  ?  ¥  x  E  LgCO.t]  (A.l) 

for  1*1,2.  Then  the  following  holds  V  t  >  0, 

2  2 

*  (el+62),y2't2  <  ,yl,t2(,ul't2  +  2 1  e  2 1  *  *  u2*  t2^ 

+  «y2»t2(,u2,t2  +  2|el|,,ul't2)  +  lel|,,ul,t2  +  ,c2'  *  ,u2*t 2 

+  Ujl  *  |a2l  (A.2) 


A-l 


-J-->  •  - 1 


■.VvV’-V.V^vvvV-.vv. 


Proofs  of  both  theorems  also  rely  on  well  known  results  for  systems 


H  e  Sq  m  •  The  results  required  here  are  summarized  In  the  following. 


Theorem  A- 2  [see  [19],  Thm.  9,  pg.  59] 


Let  H  e  Snxm  ;  then: 
o 


(1)  If  uc  L?  ,  then  y  =  Hu  e  Lj  >  e  Lj  »  y  Is  continuous,  and 


y(t)  ♦  0  as  t  ♦  •  . 


(11)  If  ue  l"  .  then  y  =  Hu  e  Ln  ,  y  e  Ln  ,  and  y  Is  uniformly 


continuous. 


(Ill)  If  u  c  Lm  and  u(t)  +  constant  c  e  Rm  as  t  ,  then 

QO 

y { t )  +  H(0)c  exponentially  as  t  +  «*  . 


In  order  to  simplify  notation  we  drop  the  superstrlct  on  l"  which 
Indicates  vector  size. 


We  will  establish  Theorem  1A  first.  Some  of  the  steps  will  be  repeated 
for  IB.  Also,  without  loss  of  generality,  the  matrix  r  In  the  adaptation  law 
(3.15) ,(3.16)  Is  set  to  Identity.  Corollary  1  Is  established  as  a  by-product. 


Proof  of  Theorem  1A 


Part  (1) 


Identify  G^,  Gg  In  Figure  A. 1  with  e  ♦  v  and  Hgv  respectively.  Also, 
let  u1  *  e*,  u  »  0,  e1  *  e,  y  *  -  v,  and  y2  =  H^v.  .  Using  adaptive 

law  (3.15)  we  obtain, 


<e,v>T  =  <e,Z'9>T  a  <Ze,a>T  *  <9,  9>T 


(A. 4) 


*  \  io(T)i 2  -  \  i 9 ( 0 ) g ‘ 


(A. 5) 


>  ~  y  19 ( 0 )| 


(A. 6) 


^  ^  "V J* r Ln j  A  * 


Thus,  using  (A.l)  gives. 


7» 

'.i 


J' 


S 


v 


5 


v, 

‘j- 


1  °1 


1 9  ( 0 )  I ' 


(A. 7) 


Since  Gg  »  Hgv  e  SPR+  by  assumption,  aw,  y  >  0  such  that  ¥  x  e  L2e> 


<x.Hevx>y  >  u> x< j2>  ,Hevx,T2  <  Y,X,T2  *  Hence»  from  ^A*^> 


G2  =  u’^2  =  ct2  =  ^ 


(A. 8) 


Using  Lemma  A.l,  together  with  (A;4)-(A.8)  gives. 


,V,T2  '*  ^,e*,T2  +  (,e*aT2  +  2u  !e(0)  |2)1/2] 


(A. 9) 


ie-e*iT2  <  yivi. 


(A. 10) 


|e (T) | 2  <  1 6 ( 0 ) | 2  +  2ie«T2  iv«T2 


(A. 11) 


The  bounds  shown  In  (4.8)  follow  using  the  assumption  e*  e  .  Hence, 


e,v  E  L„  and  9  c  L  . 
Z  « 


Having  established  that  v  e  L2  ,  Theorem  A-2  — ►  z:  =  z-z*  e  L2nL.»  z  e  L2, 
z  +  0,  and  z  Is  continuous.  Since  z*,  z*  e  l  by  assumption.  It  follows 
that  zeL  and  i  e  L  (*■♦  z  Is  uniformly  continuous).  Using  v  =  Z'9  with 


z,  s'  e  L  4  ve  L  .  Using  e  *  e+-H  v  with  e*  e  L  and  H  e  S  (by 
•  •  ev  *  «.  ev 


assumption),  and  ve  L  4  6e  L  .  Hence,  g  *  Ze  e  L  -♦sis  uniformly 

•  •  00 

continuous*^  v  *  Z'e  Is  uniformly  continuous  (since  z  Is) v  0  since 

v  e  L2  Is  established.  Using  v  -►  0^  e  -  e*  ♦  0  ,  and  since  e*  >  0  by 

assumption,  e  0  .  Furthermore,  v  +  O-*  z  *  0  exp.  and 

*»  m  • 

9  *  Ze  *  Ze  +  Z*e  ♦  0  ,  because  z  and  e  +  0  .  Using  v  a  Z'g  +  Z'9  with 

z,  9,9eL4vsL  .  Hence,  e*  *  ft*  -  H„.  $  s  l  ,  because  e.  e  L  by 

assumption.  Thus,  9  *  ie  +  Ze  e  L  •  This  establishes  properties  (i-a)- 

(1-d). 


To  show  (1-e)  consider  (3.15)  written  as: 


ITV* 


-  Svv;  :  :  ; 


9  ■  -Z#  H  Z!  9  ♦  w 
*  ev  * 

w:»  -(Z*HeyZ'  +  Z  Hey  z;  +  Z  Hgv  Z')e 


(A. 12) 


Since  we  have  already  established  that  z  ♦  0  exp.  and  a  c  l  .  it  follows 
that  w  *  0  exp.  Since  z*  e  PE  by  assumption  (provided  e*  *  0)  ,  w  (-►e  Is  exp 
stable  by  (2.15).  Hence,  0 -*■  0  exp.5^  9,  v  ♦  0  exp.-^  e-e*  ♦  0  exp.  This 
completes  the  proof  of  part  (1)  with  adaptive  law  (3.15). 


To  show  that  (i-a)-(i-a)  hold  with  adaptive  law  (3.16)  requires  showing 
that  G^:e  ->  v  is  passive.  Consider  the  typical  time  Interval, 


(  Ij  5  |tc  CtQ.tj)!  b 9 ( t ) a  <  c} 

1  = 

( I2  *  { t  e  Ctj.tg) |  a e ( t)i  >  c  >  maxj9*a } 


(A. 13) 


Hence, 


Thus, 


<e,v>  »  <e,v>  +  <e,v> 

1  lx  i2 


(A. 14) 


V>T  *  <8, 

ll 

9>I1  *  \  B  9  ( )«  2  -  2  u  9  ( tQ ) B 2 

(A. 15) 

<e,v>.  a 

‘2 

<0  +  (1  -  B  0  B  /C ) 2  9,  9  > » 

lz 

(A. 16) 

i  9  ( t2  ) «  2  - 

1  2  -  ?  * 
jiaUjii  +  (1  -  aei/c)  <0,  9>j^ 

(A. 17) 

«9(t2)|2  - 

?  leU^i2 

(A. 18) 

because  <0,  ©>.  >  0  from, 


I 

>: 
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9(t) ‘  e( t)  «  9 ( t) * [ 9 { t ) —6 *] 

*  ie(t)i2  -  9{t)’e* 

*  2  a 
>  ie(t)i  -  i 9 ( t ) i c 

*  ie(t)i (la(t)i-  c)  >0,  vt  e  l2  . 

Thus, 

1  2  1  2 
<e,V>j  >  ■£  1 9  ( t2  ) 9  -  J  »  9  ( tQ ) B 


(A. 19) 


(A. 20) 


.  .9 


\4 


□ 


A 


.s' 


ii 


r. 


Repeating  the  above  procedure  recursively , we  eventually  conclude  that 
1  2 

<e,v>T  >  -  j  1 9 ( 0 ) i  as  before  (A. 6),  and  hence,  G^e  h^v  Is  passive.  The 
results  In  (1)  now  repeat  for  adaptive  law  (3.16).  This  completes  the  proof 
of  part( 1 ) . 

Proof  of  Theorem  lA.Part  (11) 

Theorem  1A,  Part  (11)  Is  essentially  an  L  -stability  result.  The  method 

09 

of  proof  requires  the  notion  of  "exponential  weighting"  which  Is  a  means  to 
obtain  L^-stability  of  a  system  from  the  L^-stability  of  an  exponentially 
weighted  version  of  the  system  (see  e.g.,  [19],  Chapter  9).  We  require  the 
following: 

Definition:  Given  a  real  number  a  define  the  exponential  weighting  operator 
by 

x°(t)  :*  eatx(t)  (A.21 ) 

Consider  the  system  y  ■  Gu.  An  exp.  weighted  version  of  this  system  is 
denoted  by  ya  :»  Ga  ua  .  Note  that  If  G  Is  a  convolution  operator  with 
transfer  function  G(s)  then  G®  is  also  a  convolution  operator  with  transfer 
function  G(s-a)  .  Thus,  the  correspondl ng  exponentialy  weighted  error  system 
corresponding  Is  described  by 


A-5 


v.v 


m 


v“  ■  Z'e 

9°  »  a9a  +  Zea  -  p(0)9*a 


where  a  >  0  such  that 


Ka  e  SPR1"  and  Ha  e  S10 
ev  +  zv  o 


(A. 23) 


Using  Theorem  A-l,  Identify  G^  with  ea  -►  va  and  with  .  Note  that  It  Is 
always  possible  to  find  some  a  >  0  such  that  (A. 23)  holds.  We  now  examine 
the  passivity  of  G^:  ea  ♦  va  .  Thus, 


<e  ,  va>T  *  <e  ,  Z'9a>T  -  <  Zea,  9a>T 

*  <0°,  0°  -  a0a  +  p{0)0°>T 

■  j  e2aT|0(T)|2-  j  I9(0)|2  +  <p(9)0a,  9a>T-al9ailj2 


1  2a T  2  1  2  a  2 

>  ?E  I Q ( T ) |  -  -K-  1 9 ( 0 ) |  -  a!9 


(A. 24) 


The  last  line  follows  from  (A. 19),  hence,  (A. 24)  holds  with  or  without  the 
retardation  term  In  the  adaptive  law.  At  this  point  there  are  two 
possibilities:  either  s  e  L  or  ] a ( t) |  +  •  as  t  ♦  •  .  If  9eL  then  3 

••  oo 

constant  c  <  •  such  that  m  <  c  .  Then, 
o  •  o 


<e°,  v“>T  p  j  e2aT(i9(T)i2  c2)  -  j  1 9 ( o ) a 2 
>-^2arc*-^9(0)l2 


(A. 25) 


If  |e(t)|  ♦  -  as  t  ♦  •  then  It  Is  always  possible  to  select  an  arbitrarily 
large  T  such  that  ie(T)i*  i0iT-  •  Hence,  for  this  T,  (A. 24)  becomes. 


<e°,  v°>T  >  \  e2aT(i9(T)i2  -  |0|2J  -  £  I9(0)i2 


V 


V 


Thus, for  some  arbitrarily  large  T,  (A. 25)  and  (A. 26)  have  the  general  form, 
i.e.. 


<e“,  v®>T  >  -c1  e2®*  -  C2  :=  -c(aT) 
where  c2  are  non-negative  constants.  Hence, 

ej  a  Sj,  8  0,  3  -C(aT) 

Since  G2  *  H^y  e  SPR+,  3  constants  u.  y  >  0  such  that 

<x,  ^ev  X>T  *  w,xlT2 

,Haev  X,T2  <  Y  ,X,T2 

Then, 


(A. 27) 


(A. 28) 


(A. 29) 


e2  =  u,<S2=a2  =  ^ 

Using  (A. 2),  we  get 


{A. 30) 


,V<3’T2  <~4,e*,T2  +  C*e“»T2  +  ^(aT) ) ^/2] 

Since  e*  e  L  by  assumption, 

W  00 

ae®«T2  <  eaT(2a)‘1/2ae*aa# 


Thus, 

|V0,T2  <  — (4^}  —  [«e*»,  +  +  4a  e'2aTnC(aT)) 

Since  H^y  e  SgXm  ,  we  obtain 

T 

Urn  |  -  i  £  h2V(t-t)v(t)<m 


(A. 31) 

(A. 32) 

(A. 33) 

(A. 34) 
(A. 35) 


V\  V*.  -w'  V'V  OlV,-  H.  «_»V'  . 
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where  H^y(t)  Is  the  Impulse  response  matrix  associated  with  H®y  . 
Substituting  (A. 33)  and  {A. 27)  Into  (A. 36)  and  noting  that 

O  T 

e_<Ml  c(aT)  <  Cj  +  c2  ,  we  obtain, 

I z(T) |  <  (2a[|.'1/2  ,Hgv(.),1  .  [ i e*i ^  +  (i e*i2  ♦  Ao^c^))172]  (A.37) 

Since  the  right  hand  side  is  independent  of  T,  and  since  T  can  be  selected  to 
be  arbitrarily  large.  It  follows  that  2  c  Lb  .  Assuming  there  is  no 
retardation  or  persistent  excitation,  this  completes  the  proof  of  { 1 i-a)  to 
(11-d). 

Assume  now  that  z  e  PE  ,  which  Is  a  noncontradictory  assumption  since  we 
have  already  shown  that  z  e  L  .  Hence, 

QO 

§  -  -Z  Hev  V  q  +  Ze*  (A. 38) 

Since  z  e  PE,  H  e  SPR  and  z,  e.  e  L  ,  it  follows  from  (2.15)  that 
ev  +  <* 

(Ze*,  9(0))  (-►e  Is  exp.  stable,  thus,  9,  9  e  lm  .  The  remaining  results  in 
(11-e)  follow  Immediately. 


Suppose  now  that  the  adaptive  law  is  given  by  (3.16).  Then,  we  can 
wrl te. 


9  *  Z  e  -  p(e)e  *  Z[e*-HeyZ'(9-9*)]  -  p(g)e 
*  w  -  z  Hgyz'  9  -  p(e)e 


(A. 39) 


where  w  :*  Z  e.  +  Z  H  Z'9*  e  t  ,  because  z,  e*  e  L  .  Consider  the 

ev  *  •  .  -  *  » 

candidate  Lyapunov  function  V: 1 1— ^ ie ( t)i ^  .  Hence, 

V  *  2  w'fl  -  9'  Z  HeyZ'0  -  p(e)V  (A. 40) 


Suppose  ie(t)i  ♦  •  as  t  ♦ 


.  Then  there  exists  a  time  T  >  0  such  that 


»8(T)|  *  I3| 


Yj  >  c  •  Hence, 


T-  * 

<  2*«.  VT/2+  'z'l  Y.(Hev)VT  -  (1  -  vj/2/c)2VT  (A.41) 

Clearly,  there  exists  a  finite  constant  c^  such  that  when  >  c^,  <  0  . 

Therefore,  9  can  not  grow  beyond  all  bounds,  and  hence,  9  e  l  .  So  then  is 
0  and  9  ,  and  again  the  result  of  (11 -e)  follow.  This  completes  the  proof  of 
Theorem  1A.  Mote  that  in  this  case  we  do  not  obtain  specific  bounds  on  e, 
because  the  proof  proceeds  by  contradition. 

Proof  of  Theorem  IB 

Part  (i) 


Since  H  e  SPR 


ev 


.-r 


there  exists  q  >  0  such  that  G  :*  (1  +  qs)H  e  SP 

ev  ev 


and  furthermore,  G-i  e  S 
ev 


As  a  result  we  can  write  (3.14a)  as. 


e  -  -Hev  y,  y  «  v 


Gev^e* 


q  e*) 


(A. 42) 


Referring  to  Lemma  A-l,  let  G,  :  v|-^e,  G  =  H  ,  u  =  0  ,  and 

«  1  w  6V  1 

u„  ■  -G’1(e*  +  qe*)  .  Using  (A. 2)  together  with  (A. 42)  and  the  passivity 
c  ev  ” 

properties  of  H  gives, 
ev 

• e*  t2  <  ^{<u2'T2  +  C"  U2*J2  +  2w  I  ©  ( 0 )  | 2 ) 1  /2  ]  (A. 43) 

le(T)|  <  |e(0)|  +  2ieiT2  .  1 u2i T2  (A. 44) 

where  u  is  defined  In  (4.9a).  Using  (4.9b)  gives, 

,U2,T2  <  (l/k>ie*  ♦  q®*ij2  *  t09ether  with  (A. 43),  (A. 44)  and  the 

assumption  e*,  e*  e  L2  gives  the  bounds  shown  in  (4.9).  Hence, 
e  e  L  ,  a  e  L  .  However,  we  can  not  conclude  that  v  e  L,  as  in  Theorem  1A, 
part  (1).  From  (A. 42),  we  can  conclude  that  (l  +  qs)  v  e  L2  •  Since 
G  :*  (1  ♦  qs)H  e  S  ,  It  follows  from  Lemma  A-2  that 

„ZV  ZV  Ot 

z  :»  z-z*  c  Lo  n  L  ,  z  e  L«  and  z  ♦  0  .  Repeated  use  of  Lemma  A-2  and  the 
£  •  £ 

error  equations  (3.14)  gives  the  results  (i-a)  -  (1-d).  (1-e)  follows  from 

the  arguments  in  the  proof  of  Theorem  1A,  part  (1). 
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APPENDIX  B 
PROOF  OF  LEMMA  5.1 

The  proof  utilizes  the  following  known  results: 

Definition:  Let  J  denote  a  subset  of  S,  consisting  of  functions  In  S  whose 
Inverse  Is  also  in  S. 


Fact  [29]:  If  G  Is  any  scalar  transfer  function  in  R(s),  then  G  has  a  coprime 
factorization  In  $,  l.e. ,  there  exists  N,  D,  A,  and  B  in  S  such  that 
G  *  N/D  and  AN  +  BD  *  1. 

Lemma  B-l:  Consider  the  tuned  adaptive  system  of  Figure  5.2.  Let 
P*  e  R0(s)  and  c*  e  R0(s)  have  coprime  factorizations  In  S  given  by 
P*  *  %^°p  and  c*  *  Nc/Dc  »  respectively.  Then,  the  elements  of  the 
transfer  matrix  from  (r,d)  Into  (e*,  z*,y,  u)  all  belong  to  S,  If: 


(1)  Q  :•  DO  +  N  N  c  J  . 
pc  pc 


(from  [29]) 


(B.l) 


and 


Ml)  4(u>)  |T*(  j<u) |  <  1,  V  H  c  R  , 

where 


(from  [16]) 


T*  N  Nc/Q  :«  P*C*(1+P*C*) 


-1 


(B.2) 


Using  the  definition  of  Q  we  can  write  Hgv  and  Hzv  from  (5.5)  as. 


Hev  *  npQ_1M+a)(1+aT *)_1 


(B.3) 


zv 


FDpQ'^l+oT*)’1 

FN-Q-1 ( 1+A ) ( 1+aT*}"1 
P 


(B.4) 


B-l 


From  the  definition  of  K*  (5.4b),  we  also  obtain 


q  -  nk;1 

P 


(B.3) 


Proof  of  Lemma  5.1 

We  f 1 rst  show  that  ( 1 ) ,  ( 1 1 ) ,  and  ( 1 v )  *>  Q  e  J  .  Let  P .  *  M  /D  be  a 

P  p 

coprime  factorization  of  P*  such  that  rel  deg  Dp(s)  *  0.  Since  (1)  *>  rel  deg 
P*(s)  *  1,  It  follows  that  rel  deg  Np(s)  a  1.  Moreover,  (1v)  *> 
rel  deg  K*(s)  *  1,  and  that  Ki(s)  and  l^s)  are  stable.  This,  together  with 
(11)  and  (B.3)  establishes  that  Q  e  J  . 

H  e  S  follows  Immediately  by  Inspection  of  (B.2),  since:  F  e  S  by 

ZV  0  0 

assumption;  D  ,  N  e  S  ;  Q  e  J;  a  e  S  by  assumption  (vl);  and  finally  (vl) 

P  P  i 

■>  (11)  of  Lemma  B-l  *>  (1+aT*)  e  S  . 


Conditions  (1v)  and  (vl)  «>  H  e  SPR  .  This  follows  from  Lemma  4.1 

ev  o 

by  letting  TT^  »  and  letting  1  +  fl  »  (I+aHI+aTJ"1  .  Thus,  (4.4a)  Is 

satisfied  since  K.  c  SPR  from  (1v).  Also,  from  (4.4b), 

o 

kU)  -  |flev(ju)|  «  la(j<u)S*(jw)[l-a(jw)T*(da,)]‘1l  (B.4) 

6 (id)  |S*(  j(d)  | 

‘  TTCTTCTOT  '  (B'5) 

The  last  Inequality  comes  from  conditions  (vi)  and  the  definition  of 
T(m)  from  (4.4b). 

The  final  step  In  the  proof  of  Lemma  5.1  is  to  show  that  there  are  a 
sufficient  number  of  parameters  In  9*  to  Insure  a  solution  exists.  This  is 
guaranteed  by  satisfaction  of  condition  (v).  To  see  this  combine  (B.3)  with 
the  definition  of  Q  from  (B.l)  to  get 


0  :»  N  Jl  +00.  •  NKl1 


(B  .6) 


From  (5.2),  let  N  *  A../L  and  D  *1  +  A*,  be  a  coprime  factorization  of 
C  c  C  l/l 

C*.  and  let  Np  *  g  N*/L  and  Dp  *  1  +  D*/L  be  a  coprime  factorization  of  P*» 
where  P*  fs  as  defined  In  (1).  With  K*  given  by  (1v),  (8.6)  becomes  the 
polynomial  equation, 

An  KjO*  ♦  A^N*  3  KK^-KjO*)  (8.7) 

Since  deg(K2Nj  *  degO^D*)  and  ,  K2,  N*.  and  D*  are  all  monlc.  It  follows 
that  dcg[L(K  N*-K  D*]  3  deg(L)  +  degfl^)  +  deg(Dj  -  1  .  Then,  using  known 
results  on  polynomial  equations,  e.g.  [30],  It  can  be  shown  that  (v)  Implies 
that  (8.7)  has  a  solution  (A*j,  A*2)  . 
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